Convolution with Logarithmic Filter Groups for Efficient Shallow CNN
نویسندگان
چکیده
In this paper, we propose a new logarithmic filter grouping which can capture the nonlinearity of filter distribution in shallow CNNs. Residual identity shortcut is incorporated with the filter grouping to enhance the performance of shallow networks. The proposed logarithmic filter grouping is evaluated using a compact CNN structure with logarithmic group convolution modules which are composed of logarithmic filter groups and a residual identity shortcut. Our classification results on Multi-PIE dataset for facial expression recognition (FER) and CIFAR-10 dataset for object classification revealed that the compact CNN with proposed logarithmic filter grouping scheme outperforms the same network with the uniform filter grouping in terms of accuracy and parameter efficiency. Our results indicate that the efficiency of shallow CNNs can be improved by the proposed method.
منابع مشابه
Optimizing Filter Size in Convolutional Neural Networks for Facial Action Unit Recognition
Recognizing facial action units (AUs) during spontaneous facial displays is a challenging problem. Most recently, CNNs have shown promise for facial AU recognition, where predefined and fixed convolution filter sizes are employed. In order to achieve the best performance, the optimal filter size is often empirically found by conducting extensive experimental validation. Such a training process ...
متن کاملUsing filter banks in Convolutional Neural Networks for texture classification
Deep learning has established many new state of the art solutions in the last decade in areas such as object, scene and speech recognition. In particular Convolutional Neural Network (CNN) is a category of deep learning which obtains excellent results in object detection and recognition tasks. Its architecture is indeed well suited to object analysis by learning and classifying complex (deep) f...
متن کاملUnderstanding learned CNN features through Filter Decoding with Substitution
In parallel with the success of CNNs to solve vision problems, there is a growing interest in developing methodologies to understand and visualize the internal representations of these networks. How the responses of a trained CNN encode the visual information is a fundamental question both for computer and human vision research. Image representations provided by the first convolutional layer as...
متن کاملDesign of Linear Cellular Neural Networks for Motion Sensitive Filtering
Recently, several researchers have proposed using spatio-temporal filters for image motion analysis. For example, the optical flow field can be calculated from the output of a set of spatio-temporal filters. Some of the most popular spatio-temporal filters are the space-time Gabor filters, obtained by convolving a time varying image with a space-time Gabor function. Based on the cellular neural...
متن کاملConvolution in Convolution for Network in Network
Network in network (NiN) is an effective instance and an important extension of deep convolutional neural network consisting of alternating convolutional layers and pooling layers. Instead of using a linear filter for convolution, NiN utilizes shallow multilayer perceptron (MLP), a nonlinear function, to replace the linear filter. Because of the powerfulness of MLP and 1 x 1 convolutions in spa...
متن کامل